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ABSTRACT 


The  theory  of  series  cyclic  queues  is  generalized  to  other 
configurations  such  as  branching  series  queueing  models.  An  equivalence 
relation  is  developed  between  time  average  steady  state  probabilities  and 
the  stationary  probabilities  of  the  imbedded  Markov  Chain  of  a  series 
cyclic  queue.  A  statistical  inference  model  is  developed  to  estimate 
the  mean  exponential  service  rate  for  a  series  cyclic  queue  model. 


1.  INTRODUCTION 


In  two  early  papers,  Koenigsberg  [l],  [2]  developed  the  theory  of 
cyclic  queues  and  showed  an  equivalence  among  cyclic  queues,  finite 
queues,  and  the  Swedish  Machine  problem.  A  cyclic  queue  is  characterized 
by  the  following  congestion  problem: 

M  service  centers  are  linked  together  in  series  such  that  the 
output  of  the  last  center  is  the  input  to  the  first  one;  there  are  N 
items  in  this  closed  or  cyclic  system  being  serviced  'Ey  each  of  the  M 
centers  in  turn.  Such  a  system  may  characterize  the  m^aicg  of  ores, 
maintenance  of  aircraft  or  machinery,  busy  period  operations  qf ^transit  — 
systems,  etc. 

Koenigsberg  assumed  that  the  service  time  at  each  stage,  i  ,  was 
exponentially  distributed  with  parameter  and  the  queue  discipline 

is  first  come,  first  served;  he  was  then  able  to  find  steady  state 
time  average  probabilities  and  various  measures  of  effectiveness  of 
the  system. 

In  the  applications  of  this  theory,  one  encounters  the  following 
problems : 

1.  Service  rates  are  unknown. 

2.  The  hypothesized  series  configuration  does  not  fit  real  models. 
For  example,  in  a  coal  mine  where  N  shuttle  cars  dump  their 
coal  at  one  loading  point  and  return  to  their  respective  working 
areas,  there  is  congestion  only  at  one  service  station  and 

each  shuttle  car  may  return  to  any  of  M-l  working  faces. 

In  aircraft  maintenance,  there  can  be  a  network  of  service 
stations  and  only  fixed  proportions  of  the  planes  serviced 
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require  service  at  each  station. 


In  this  paper,  we  will  attack  the  first  problem  by  developing  a 
relationship  between  Markov  chains  and  time  average  probabilities  in  order 
to  use  the  methods  of  Billingsley  [3]  and  Wolff  [4]  to  make  some 
statistical  Inference  about  service  rates;  we  will  also  deal  with  more 
general  configurations  of  cyclic  queues. 

2.  SOME  DEFINITIONS  AND  A  REVIEW 
OF  KOENIGS  BERG'S  RESULTS 


Let,  i  =  the  name  of  a  service  center  i  =  1...M 

a  mean  exponential  service  rate  at  service  center  i 
n^  =  number  of  items  at  service  center  i  which  includes 
those  waiting  for  service  plus  the  one  in  service 

J  »  state  of  the  system  where  it  is  understood  that  J 
stands  for  (n^.^.n^) 

P  =  time  average  probability  that  the  system  is  in  stage  j 

J 

N  »  total  number  of  units  in  tne  system  which  is  clearly 
equal  to 

i 

i=l 

Ir  an  indicator  function 

L*  J 

J  =»  total  number  of  states  in  the  system 
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The  steady  state  equations  of  state  are,  (after  Koenigsberg  [_]; 

i=M 

P(rT'  ’  •  "«>  -  ‘h  ^-‘i  > 

i=l 

i=M 

\ 


L  (n^.  .  .^+1,^  -1,. . .  ,i»M)  *[n  >  0] 

i=l  ''  1 


Tiie  solutions  take  the  form, 


(2.1) 


L 


.) 


W-n 
1  1 


M  n , 


(n.  ••  q 

II  |d. 

i=2 


1 

TI 


where 


=  P.  ,  has  been  evaluated  for  M  «  1...5  by 

2^'  (N ,0,  .  ,  0 ) 

M 


,N 


Koenigsberg  [  1  ] ;  in  general,  ^  ^  can  be  evaluated  by  summing 

the  probabilities  over  all  possible  states. 


CYCLIC  QUEUES  AND  MARKOV  CHAINS 


M , 


Let 

the  mean 


be  the  service  time  of  any  machine  at  the 
exponential  service  rate.  That  is, 


center  and 


p[t .  <  l  ]  -  i  -  exp  (  -i!  .  i. )  . 

l  -  i 

We  know  that  the  condi  t  i*  sal  distribution  ol'  so  ■  i<  e  tdi.es  given  the 
long'n  of  time  in  service  is  identical  to  the  unconditional  distribution 
With  the  added  assumption  that  the  are  indendent  random  variables, 

a  cyclic  queue  with  exponential  service  times  is  a  continuous  time 
Markov  process  with  a  discrete  state  space. 


Let, 


n^j)  » 

K  - 


number  of  units  at  service  center  i  in  state  J 
transition  count,  discrete  time 
stationary  Markov  chain  probability  of  being  in 
state  J  just  after  a  transition 
Markov  transition  probabilities 


The  transition  probabilities  are  given  by, 


i-M 

ill  -i] 

_ 

^  ‘"l  I[n1(j)  >  0] 

if  j  to  i  is  possible 
0  otherwise 


To  prove  this  result,  first  consider  the  case  where  M 


3  and  N  ■  2. 


The  transition 

matrix 

is, 
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Examine 


020)  ' 


Call  this  eve.it  G  . 


The  probability  of  G  ,  P(G)  ,  is  just  the  probability  that  in  the 
next  small  interval  of  time  dt  ,  there  is  a  service  completion  at  center 


1  and  no  completion  at  center  2  until  after  the  completion  at  1,  averaged 
over  all  dt  . 


P(G) 


dt 


dt 


V  U2 


The  general  result  follows  directly.  The 
probabilities  because, 


II  .  are  true  transition 

H 


I 


Because  we  have  a  finite  state  space,  there  exists  a  set  of  stationary 
probabilities  IT. .  that  are  the  solution  of 


(3.1) 


nj  "  L  nx  n^j 

i 


The  formula  for  11^  can  also  be  derived  from  Billingsley's  [3J 
"intensity  functions"  where  we  interpret  the  numerator  as  the  intensity 
of  a  jump  into  the  state  it  represents  and  the  denominator  as  the 
intensity  of  jumps  out  of  the  current  state. 


U.  RELATIONSHIP  BETWEEN  II.  AND  P 

J  J 

We  can  think  of  II.  as  asymptotically  equivalent  to, 

J 

Expected  number  of  transitions  into  state  J 
Expected  number  of  transitions  in  the  system 


The  number  of  transitions  out  of  state  J  differs  by,  at  most, 
one  from  the  number  of  transitions  into  J  for  some  time  period  T  . 


Assuming  stationary  starting  conditions,  the  expected  number  of 
transitions  out  of  state  j  in  time  T  is 


V  L  XK(J)  >  0] 

iWL 


and  the  total  number  of  transitions  in  the  system  during  time  T  is. 


L  \r  L  I[n  (j)  >  o]  . 

j=i  i«i 


As  T  -*  oo  , 


(4.2) 


PJl^i  I[n1(j)>  0) 

>  °] 


It  can  be  shown,  after  much  tedious  manipulation,  from  the  solution  of 


(3.1)  that, 


(4.3) 


M  ni^)  m 


>  0] 


US  “1  1.1  * 

M  11,  n,(TTM 

n  (4i)  1  - 


z  M.I, 


No.-  from  (4.2)  *»nd  (4.3)  it  is  obvious  that, 

M  n  ni(j) 

p,  -  c  u  .  n  (■— ) 

-  2  M  i„2  ^i 


where  C  is  some  constant  independent  of  j 


Let  C 


^2*  *  *^M 


then 


M 

n 

i=2 


<V 


n.  (J 


\ 

) 


but 


Therefore 


1=2 


P.  = 

1 


_1 

■* 

M 


n0(j)  r^Tj) 

U-£*  *  *  *  ^*|yj 


which  is  (2.1),  Koenigsberg 's  result.' 

From  equation  (4.3)  we  can  derive  all  of  the  II.  and  use  them 

J 

to  solve  for  the  P.  in  equations  (4.2).  No  claiu  is  made  that  computing 

J 

p.  from  the  II.  is  easier  than  using  equation  (2.1);  however,  if  we 

J  J 

consider  a  system  that  is  a  variation  on  the  more  general  cyclic  queue 

(see  Koenigsberg  [2]  ),  the  construction  of  the  state  space  and 

solution  for  the  II.  might  prove  to  be  an  easier  task  than  setting 

up  the  differential  equations  and  solving  for  the  P  .  Koenigsberg ' s 

J 

approach,  however,  yields  the  transient  solutions  if  they  are  of  interest. 
Equation  (4.3)  establishes  the  link  between  the  theory  of  Markov  chains 
and  the  time-oriented  queueing  formulation  for  cyclic  congestion  systems. 


3.  STATISTICAL  INFERENCE  IN  CYCLIC  QUEUES 

Statistical  inference  in  a  cyclic  queue  may  be  necessary  in 
actual  application.  Koenigsberg ' s  [l]  original  study  was  motivated  by 
a  coal  mining  problem  where  some  of  the  data  were  known  and  some 
assumed.  Given  an  actual  cyclic  system,  we  might  be  given  the  service 
rates  and  the  time  average  probabilities  under  the  assumption  of 
exponential  service  times. 

If  we  are  not  satisfied  with  the  current  data  we  could  observe 

the  system  and  note  the  transitions  that  actually  occurred  and  the 
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length  of  time  between  transitions.  From  this  data  we  can  use  the 
methods  developed  by  Billingsley  [3]  to  estimate  the  service  rates 
and  test  hypotheses  concerning  these  estimates. 


The  method  used  here  parallels  the  development  by  Wolff  [4], 
Define  as  the  likelihood  function  for  a  sequence  of  S 

observed  transitions  in  a  time  interval  T  ,  where  9  is  a  k- 
dimensional  vector  of  unknown  parameters. 


Let 


US1  "  de;  ln  lt(-) 


u 


<US1'  Us2'*  * • ^ 


sk' 


We  sure  interested  in  the  asymptotic  properties  of  the  function 

/s 

U  and  of  the  maximum  likelihood  estimators,  9  ,  obtained  by  setting, 

s 

u  -  0 

s 

As  T  ,  S  -♦  »  a.  s. 

As  T  -♦  00 


(5.1) 


u  X 

■=#  -  N(o,  a(9)) 

vs 


where  a(9)  is  the  variance-covariance  matrix  of  9  .  Also, 


(5.2) 


(9  -  0)  x  -1 

- 1  -  N(0,  O  (9)) 

VS 


The  proofs  for  (5.l)  and  (5.2)  are  given  by  Billingsley  [3]. 
Moreover,  if  we  assume  that, 


,0 


H0:  9  =  9  and  Hn  is  true,  then 


(5.3) 


2 [Max  ln  1^(0)  -  In  LT ( ©° ) ]  - 
0 
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A  statis ticai  inference  analysis  of  cyclic  queues  follows;  note, 
howe.er,  that  we  are  making  statements  only  about  asymptotic  prope 'ties 
of  estimators. 

Let  0(k,  j,  £)  -  likelihood  due  to  the  transition,  where 

the  system  moved  from  state  j  to  state  £  . 
i(k ,  .j,  £)  =  time  spent  in  state  j  on  transition  k 

=  (lk-i  -  tk) 


Assuming  exponential  service  times,  it  is  easily  shown  that 


(5.M 


M 

V 


f(i(k,  j,  i) )  -  L  (j)  >  o] 


i*l 

M 

V 


exp  ^-T(k,  j,  £)  Z  (J)  >  o] 

1=1  1 


where  the  indicator  function  now  depends  on  k  .  The  transition 

th  .  . 

probability  for  the  k  transitior  is  obtained  from  (5.1). 


M 


b.rj) 


n 


iflUiIk[i,i(£)  =  n±  ( j  )-l] 

(k,  j,  i)  =  li  " 

if1l,iIk[n1(j)  >  0] 


Then  0 


(k, j , £) 


is  Just  the  product  of  i1}.'*)  and  (o.5). 


M 


0 


(k, j,£) 


.  ,  Ui\r.U)  =  n  (,j )  -  1] 
i=l  i  i 


exp  \ -1 


(k,j,£)  L  ui>- 


..  1  K[n  (J )  >  0] 

l-l  1 


J 


We  assumed  S  transitions  occurred  in  time  T  .  The  probability 
/  st 

that  the  (S  +  1)  transition  occurred  after  T  is, 


ptVi  >  T  '  ts+i^ 


exp  V  -t 


S+l  Ki  S+l 

i-1 


[n±(j )  >  0] 


Assume  also  that  a  stationary  distribution  in  time  exists.  Then  the 
observations  start  when  the  rystem  is  in  state  P(0)  ,  say.  The 
likelihood  function  is  given  by, 


/  M 

(5.6)  1^(9)  *=  P(0)exp  (-Tg+i  ^ 


n  S 

L  ui  S+l[  (J)  >  0]ll 
i=*l  i 


or  more  conveniently, 


(5.7) 


r  (8)  .  lnP(O)  -  T  )U  I 
^  S.1  LlM|ni(j)>0] 


+  2  lrp(k,J,i) 


In  large  sample  theory,  the  starting  conditions  can  be  neglected. 

M 

In  L  (9)  -  -T  n  y,T 

T  s+l  L  i  S+1[n  (J)  >  0] 

1=1  1 


+  )  lnp(k,J,i) 
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(i  V 
\  •  1  / 


In  L,  (6) 


S  M 

v 

Lr. 

k=d  i=i 


Vk 


[n.U)  =  n.(j)  -  1] 


S+l  M 

r  V 

u  i 


In  order  to  estimate  the  M  parameters,  ,  it  will  be  convenient 

to  .redefine  the  summation  indices. 

Let  d^  -  the  number  of  times  during  T  that  the  completion  was 

at  stage  i  . 


S+l 

v 

L  V, 


k=l 


[  n±  ( i )  =  n±  ( j  )  -  1] 


Then, 


S 

V 


M 


In 


U 

i  k 


k=l  i=i 


[ni (i) 


n.  (J  ) 

l 


-  1] 


M 

,Ldi ln  ui 

1=1 


Let  =*  the  amount  of  time  during  T  that 
S+l 

-V'  T  I 

hk.j.ifkj  (J)  >  0] 

k=x  i 


rii  (.  )  >  0 


Then, 


S+l  M 

Vt  V  I 

L,  (k,  J,£)  -  i  kj-  (j )  >  o] 
k-1  i=l  L  i  J 


M 

V 


r  u 

i  i 

i=l 


and 


M 


m  lt(J 


V 


d  ln  u 

1  i 


i=l 


M 

V 

x  Vi 

i  =1 


Let 
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duL^) 


—  -  r  =  o 

ui  1 

and  the  maximum  likelihood  estimator  of  p..  is  , 


U  *  — 

1  ri 


i  =  1,... ,M 


In  order  to  obtain  the  variance -covariance  matrix  we  use  a  procedure 
of  conditioning  on  a  particular  transition,  then  on  the  state  and  finally 


removing  the  conditioning. 

Let  G  ■  ->c— —  In 


Vi  “  ^4  xn 


n 

ln  v.j ,D  ■ ln  I 


U  1  “[n^i)  =  n^j)  -  1] 


(k,J,£)  L  i  k[  (j)  >  o] 

1=1  i 


Consider  a  particular  i  =  i*  ,  say, 


*  '  T(k,J,i) 


if  i  »  i* 


1  ^  i* 


in  p 


(u^)5 


i,  j 


0  otherwise 
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Then, 


Also, 


V(G  *  |  (k,j,£) 

4 


=  -  K  ( G  *  *  |k,  .;,£) 


lliui 


1  4 

7^7  ~M - 

l4  >  Z  (1,  i 


i=l  ik[ni(j)>0] 


*  M 

^  ^  4*k 


1  1=1  ‘  k  [  r» i  (t  )  >  Oj 


V(G  *)  =  E[V(G  *  |  j)] 

ui  lli 


L 


V 

L 


>1 


v(g  *  |  j)n. 

4  J 


V 

L 

j  ( j  )>0 


7 - ^ 

Ui  ^  11  i 1 C n* ( J  )  >  0] 
1*1  i 


Substituting  (U. 3)  for 

(5.9)  V(G  *) 

4 

Koenigsberg  defines  as  the  fraction  of  time  the  i  stage  is 

working;  the  numerator  of  (5.9)  is  precisely  .  If  we  expand  terms 
in  the  denominator  we  have, 

D, 

V(G  *)  =  -J— 

4  i^MR 

where  R  =  ^  is  the  output  of  the  system  and  is  the  same  for  each 

stage  i  .  Then, 
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n. 

j 


u. 


z  p, 


J  ■ni  (  j  )>0 


L  M  * 

I  P  Z  U  I 
j=l  Ji-1 


[n*(  j  )  >  0] 


V(G 


1 

~~r~2 

«(u  ) 


o(8) 


is  a  diagonal  matrix. 

We  are  interested  in  the  inverse  of  c(o)  . 


(5.10) 


V 

asymp 


M(U*)2  . 


Note  also  that  the  asymptotic  variance  has 

form  if  we  normalize  on  T  instead  of  on  S  . 

leng  to  multiplying  (5.10)  by  the  limiting  form 

clearly  —  — -  .  The  variance  becomes 

™i  ui 

* 


(5.10a) 


V 

asymp 


(Vt(u2  '  ‘V 


a  slightly  different 
The  change  is  equiva- 
of  T/S  which  is 


Now  the  dependence  on  the  time  average  probabilities  appears  formally. 

In  order  to  test  hypotheses  on  the  |i^  ,  we  make  use  of  equation  (5.5). 

Noting  that  the  maximum  over  [i  of  the  likelihood  function  is  obtained 

when  we  substitute  the  maximum  likelihood  estimators,  the  test  that, 

0,0  0. 

U  -  (u1,...,mw)  is  given  by, 


M  M 

Vh  ,  0.  V 

i=l  1=1 


ri^i 


We  can  define  an  appropriate  constant  for  any  level  of  significance  and 
check  that  the  test  quantity  does  not  exceed  the  constant. 

In  particular  we  might  want  to  test  the  nested  hypothesis  that  all 
of  the  are  equal.  The  likelihood  equation  (5.8)  reduces  to, 


In  ^(y.)  =  S  In  [i 


r 


i 
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and 


U 


s 

M 

Z 

i=sl 


The  appropriate  test  quantity  becomes, 

r  M  M 

I  I  * 

2l  ..V'Vi1  -31n(s'  hYY 

i=l  i=l 


6.  SHUTTLE -CAP  MODEL  -  RANDOM  ASSIGNMENT 


Consider  the  problem  where  the  outputs  of  K-l  service  centers 
feed  into  a  single  service  center.  After  a  unit  is  serviced  at  the 
common  center  it  it  dispatched  to  one  of  the  other  K-l  centers 
by  some  random  device. 

One  might  describe  the  operation  of  a  motor  pool  in  this  way, 
wheie  the  common  center  is  a  maintenance  station  and  the  others  are 
operating  stations.  By  random  assignment  we  mean  that  any  serviced  item 
can  be  sent  to  any  other  center  as  long  as  a  fixed  proportion  of 
items  are  sent  to  eath  stage. 

Let  p  =  probability  that  an  item  completed  at  stage  1  is  sent 
1  i=K 

to  stage  i.  Then,  Z  P  =  1  and  the  steady  state  equations  are, 

i=2  li 


(rY 


i=K 

x  Y  u  ir 

•  D.J  /  Y  [n 


K 


[nt  >  0] 


i=l 


=  Up  Px  ,  P 


i-2 

i=K 


li  (rip+  1 


C ni  >  0] 


+  _  Y  (lb"  +l,...,n  )  I 

i=2  1  1  K  U 


[nx  >  0] 


-IS- 


The  solutions  lake  the  form 


(6.1 ) 


n 


N-n, 
1  ' 


‘  n 

n  i.,i 

X  4- 


K 

n 


n 

hi1 


(N,C.  ..0) 


which  bear  a  resemblance  to  (0.1,'.  From  (6.1) 
various  measures  ci  effectiveness  to  analyse  a 
section  5  ve  defined  the  output  of  stage  i  as 
for  every  i  they  were  equal.  In  our  present 


we  can  compute  the 
given  system.  In 

and  remarked  that 
model  we  have, 


and 


icr  i  ,  j  t  1 


K 


i 


7.  SHUTTLE-CAR  MODEL  -  FIXED  ASSIGNMENT 


In  this  model  we  tag  the  units  at  the  common  center  so  that  they 
are  sent  to  the  "correct"  center.  In  some  sense  this  is  a  more 
realist!:  model  the  previous  one  because  in  a  mine,  for  example, 

a  shuttle  car  wnl  usually  return  to  the  same  face  on  every  trip,  or 
cars  in  a  motor  pool  may  be  permanently  assigned  to  specific  stations. 

The  analysis  requires  a  few  special  definitions. 

Let,  1.  -■  To  tel  number  ol  Items  at  stage  1 

-  number  of  items  of  type  i  .  i  -  2.  . .  K  .  Thus,  the 

items  travel  in  the  loop  1  i  -*  1  . 

/** 

n .  r._  i  -  t.  .K 

n,  -  ’u.  .  .  ,n.  I  where  n  -  j  moans  a  type  i  unit  is 

jy  4 

X  “  j-i  1  ire  ?t  center  1  . 
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K-L 


Ir  .  ,  a  total  number  of  type  1  items  at 

Ln  =  ij 

Kal  iK  stage  1  . 


n  +  1  3  (n  ...  n  ) 
1  i0  iL 


n  -  1  a  (n 
1  i±'  " 


L-l 


Then 


N  =  N 
i 


i=2 


and  the  steady  state  equations  are, 
(7.1) 


’(yv--V  IN  I["i 


>  o] 


t°l 


II  >  u  ~  a  a  A  T  A 

1  Z,  (n.+  1,  n  n  -1  n  )  [n  >  0] 

1=2 


+  u  P 


A  A  A 


\  (n1-1'r2"-nn1  +  1 . nK)I[^>0]' 


The  solutions  are, 

(7.2) 

K  /Ui 

VrViliJ 

Proof : 

Assume  n  >  0  and  n  >  0 
i  y  1  ' 

then 

K 

Lu i  P(^  +  i, 

1-2 

K  t 


(l^) 


K 

1+  Z  t 
i=2  3 


i=K 


K' 


"iP 


i=2 
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The  second  term  on  the  right-hand  side  becomes, 


A  ,  ^  \  s 

V  l,...,nK) 


K 

n 

1=2 


K 


)  Z  V1 

i=2 


.  N  )u 


=  ui  P(0,n2...nk)  • 

Summation  gives  the  required  result.  Note  that  in  (7.2)  the  results 

do  not  depend  upon  the  order  of  items  at  stage  1.  Therefore,  let 

t  a  (t  . . . t  )  .  Then, 

-L  K 


the  output  of  stage  1  is  given  by 


i=2 


which  is  the  same  relationship  as  in  the  random  assignment  model. 

A  comparison  of  fixed  and  random  assignments  is  helpful  in 
determining  optimal  operating  policies.  Suppose  there  are  two  shuttle 
cars  that  carry  coal  from  two  separate  working  faces  to  a  central 


dumping  station.  Let, 


dump 

Liface  1 

uface  2 
N 


1 

2 

1.5 

r 

C. 


For  the  random  assignment  let 

1 

P  = 

dump, face  1  2 

1 

P  =  -  ; 

dump, face  2  2 

and  for  the  fixed  assignment  let 


The  results  are  summarized  in  Table  7-1. 

TABLE  7  1 

OUTRfT  (CARS/UNIT  OF  TIME) 


DUMP 

FACE  1 

FACE  2 

RANDOM 

.862 

.431 

.451 

FIXED 

.905 

.480 

.425 

The  fixed  assignment  gives  a  higher  output;  this  result  is  not 
surprising  because  random  assignment  allows  the  possibility  that  both 
cars  go  to  the  slower  face.  Moreover,  the  effect  of  both  cars  at 
the  slower  face  overbalances  the  effect  of  both  cars  at  the  faster 
face.  One  also  notes  that  if  the  service  rate  of  the  slower  face 
is  increased  towards  the  higher  rate,  the  random  assignment  strategy 
is  even  worse  than  before  because, with  a  fixed  assignment,  there  is 
never  any  waiting  at  a  working  face. 
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8.  NETWORKS  OF  CYCLIC  QUEUES  -  MAINTENANCE  MODEL 


In  this  model  we  have  a  closed  loop  system  much  like  a  network. 
The  work  flow  of  a  typical  maintenance  configuration  is  shown  in 
Figure  8-1 . 


FIGURE  8-1 

It  is  clear  that  for  such  a  model  we  want  no  queues  at  any  of  the  operating 
stages  so  we  would  have  as  many  parallel  "services"  as  necessary  to 
handle  all  of  the  items. 

In  order  to  solve  the  steady  state  equations  for  such  a  model  we 
must  make  certain  definitions  and  assumptions.  Notice  that  in  the  model 
in  Figure  8-1,  there  is  only  one  point  at  which  items  may  leave  one 
main  branch  and  go  to  another.  The  main  ekes  here.^re, 
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(I):  0-1-', 

(II);  0-2-U-n 

(III):  0----7 

(IV):  0-3-8 


and.  the  crossover  chains  are 


0-1-2 


0-3-2  . 

If  the  model  contains  crossovers  from  (il)  tack  to  (i)  and  (III)  then 

there  are  large  combinatorial  problems  in  depicting  the  flow  of  work 

in  the  system.  We  therefore  make  the  restricting  assumption  that  there 

is,  at  most,  one  crossover  point.  As  we  will  see,  the  steady  state 

probabilities  depend  upon  a  function  that  describes  the  possible 

paths  the  items  took  in  reaching  their  stations  from  station  0. 

Define, 

’  -  UK 

goes  to  stage  £  . 


p  =  probability  that  a  completed  item  at  stage  i 
I  £ 


5  =  [£:  PU>  0,  i  =  0...M) 

_1  if  there  exists  a  branch  from  station  i  to  station  £  f 

hi  =  l£  >  0 

0  otherwise 


T  = 


U£  + 


n  T 

i  £i 


which  is  the  total  number  of  items 
at  station  £  or  beyond,  where  n^ 
refers  to  the  number  of  items  at 

station  i  in  the  state  vector  (n  .  ..n  ) 

0  M 


V 

u 


[£:  £  =  1. .  .  M,  £  #  2} 

{£:  £  f  0,  £  *  2,  £  ?  i} 


02 


P02  +  L  i€V  ?0£  T0£  V £2  Ti2 


which  is  the  probability 
that  a  completed  item  at 
station  0  ever  gets  to 
station  2. 
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(n0-.-nM) 


T0  M 

PS2  hfi 

£eU 


rrhe  steady  state  equations  are, 

i-M 


P(n  .  ..*•  )  ZL  UiI[n  >  0] 

0  M  i-0  1 


i=*M 


I  I, 

i=o  Uo 


^ i  P(nQ.  •  -n^i 


'nr1,-‘,,nM)  1[n]t-l  >  0] 


and  the  state  probabilities  are  given  by, 

N-n, 


(6.1) 


V- 


0 


(  nQ  •  .  .  nM  } 


0 


n  n 

n  u,  i 

i=i 


P(N,0...0)  Y(nQ. 


V 


Equation  (8.1)  is  an  appealing  result  because  except  for  the  function 
y,  >,  it  is  the  same  as  (2.1),  Koenigsberg ' s  result  for  the  simple 

(V*  ’V 

series  cyclic  queue.  The  function  X,  \  has  the  following  enlightening 

(no-”V 

interpretations : 

Considering  only  the  transitions  of  the  items  from  station  to 

station  independently  of  the  time  behavior,  X(  ^  is  the  Joint 

'n0’ ’ *  M' 

probability  that  N  items  at  station  zero  will  arrange  themselves 

according  to  the  state  vector  (nn’*'nu^  •  P^oof  of  (8.1):  Note  that 

U  M 


for  i€ U 

(6.2) 


(n0...ni+l..  .n^-1..  .nM) 


(V"nM) 

hi 


Then , 
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L  L Vltl  P(vvl--v1-nM) 


1=0  i€S 


(o.  5) 


L  •  P(n  ...  n  +1..  .  n  -1..  .n  ) 

1=0  £eU  0  i  1  M 

*  P‘°’11  P(n0-l-.-Vl-'-nM) 

+  Pi2Ul  P(n0...ns-l...r,1+l...nM)] 


The  first  term  or.  the  right -hand  side  of  (6.  f)  becomes,  after  using 
(8.2)  and  realizing  that  the  sum  on  i  is  really  only  a  partial  sum, 


urp(,.  ...n  )  ■ 

Uv  0  M 


For-  the  second  term, 

Y(V1.  ..  Vl...nM)  =  Y(n0...nM)Q01 

where  Q  is  the  product  of  all  the  branching  probabilities  from  station 
0  to  station  i  .  It  can  easily  be  shown  that 
i=M 

^  Q  P  «  1 

L  Oi  10 

t-O 


Therefore, 


10  i  (nQ-l.  . .  n^+1,  n^)  o  (nQ. . .  n^) 


Similarly  the  last  term  or.  the  right-hand  side  can  be  shown  equal  to 


M  P.  \  .  Hence,  we  have  shown  that 

2  <V  V 
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i=M  ^ 

*  L  PiX  Mi  P(n  ...r :  +1. 

i»0  ieS  0  1 


L  “i  r  W 


which  are  the  steady  state  equations.  Q.  E.  D.  As  usual,  ore  can 
compute  the  various  measures  of  effectiveness. 


>.  JOBSHOP  SYSTEMS 


Consider  a  model  in  which  transitions  are  possible  from  any 
station  to  any  other  station  in  a  closed  system.  Such  a  model  is 
similar  to  the  jobshop  queueing  model  except  that  it  is  a  closed 


system. 


From  our  observation  in  Section  8  about  the  function  Y 


(n0"*nM) 


we  might  expect  that  the  steady  state  probabilities  for  the  jobshop 
model  are  of  the  form, 


>(VnM)  "  M  n  P(N,0...0)  Y(nQ...nM) 
n  a  i 
i=l 


where  Y 


(n0...nM) 


represents  the  joint  probability  that  N  items  at 


station  0  will  arrange  themselves  according  to  the  state  vector 
(hq. ..^m)  •  This  function  differs  from  the  one  in  Section  8  in  that 
it  includes  all  possible  paths  for  the  items;  evaluation  of  such  a 


function  is  a  tedious  combinatorial  problem. 
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